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ABSTRACT 


This  paper  discusses  briefly  the  digital  and  analog  synthesis  of 
several  optimum  and  quasi-optimum  minimum-time  controls  for  systems  with 
real,  null,  and  complex  eigenvalues „  Controls  are  designed  using  nonlinear 
feedback.  Examples  demonstrate  the  simplicity  of  the  design. 

An  example  of  the  control  of  a  nonlinear  system  is  given  using  a 
technique  which  is  effectively  a  linearization  of  the  system  about  each 
state  point  on  a  trajectory.  A  quasi-optimum  minimunrtime  control  is 
generated  by  substituting  the  nonlinear  functions  of  the  states  for  their 


respective  linearized  characteristics. 
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I  INTRODUCTION 

The  purpose  of  this  paper  is  to  demonstrate  to  the  practicing  engineer 
the  simplicity  of  synthesis  of  several  minimum-time  controls.  The  emphasis 
herein  is  to  move  quickly  from  the  theory  in  bang-bang  controls  to  the  task 
of  generating  the  control  functions  in  terms  of  the  state  variables  or  feed¬ 
back  variables. 

The  task  is  to  design  a  physically  constrained  control  which  will  drive 
the  state  vector  from  some  initial  condition  to  the  origin  of  the  state  space 
in  minimum  time  „ 

Simple  controls  using  nonlinear  feedback  are  demonstrated.  In  all  of 
the  examples  shown,  the  problems  were  simulated  on  both  digital  and  analog 
computers.  One  of  the  examples  represented  the  control  of  a  motor  with  a 
digital  computer. 


-  1  - 


11  Mathematical  Development 


Pontryagin’s  Maximum  Principle  [1  ]  enables  one  to  show  that  a 
minimum  time  control  acts  at  its  maximum  effort  whenever  the  measure¬ 
ment  of  the  error  is  above  the  noise  leveL 

The  system  to  be  considered  may  be  described  in  general  form  as 

x  =  Fx  +  Du  (1) 

or 

x  =  f(x  ,  u)  (1  ) 

We  will  restrict  ourselves  to  linear  systems  with  nonlinear  sat¬ 
uration-type  control.  That  is:  F  is  a  constant  (n  x  n)  matrix,  x  is  an 
n-vector  representing  the  error  states  of  the  system,  D  is  a  constant 
vector,  and  the  control,  u  ,  is  a  scalar  and  is  constrained  (|u|^N). 

From  the  Maximum  Principle  we  see  that  u  will  operate  at  its  max¬ 
imum  values.  This  is  easily  seen  by  noting  that  u  appears  only  linearly 
in  the  Hamiltonian: 

H  =  LpT^  (maximum)  (2) 

where  the  p^  are  the  adjoint  variables  given  by 


v  “  2  - 


(3) 


_t 

£  r=-  tF  £ 

and  the  are  the  rows  of  (1).  To  obtain  the  maximum  of  H  with  respect 
to  u  requires  that 

u  =  Nsgn  (Edj^)  (4) 

One  may  avoid  the  task  of  determining  the  adjoint  variables  by  gener¬ 
ating  the  control  as  a  function  of  the  states.  This  then  gives  simply  a  feed¬ 
back  control. 

A  heuristic  argument  for  generating  these  control  functions  follows. 

We  have  an  initial  value-final  value  extremal  problem  with  a  cost  function 
and  a  set  of  differential  equations  of  constraint.  Starting  at  some  initial 
state  x  (0)  =  C  ,  we  desire  to  reach  x  (T)  =  0_  in  minimum  time.  If  the 
solution  to  the  differential  equation  is  unique  there  are  only  two  trajectories 
passing  through  the  origin  for  the  two  values  JN  of  the  control.  If  the 
differential  equation  is  of  second  order,  these  two  trajectories  completely 
separate  the  space  (phase  plane  for  second  order  systems).  If  we  can 
geometrically  describe  these  trajectories  in  terms  of  the  state  variables 
we  will  have  our  control  function  [2,3].  This  is  best  seen  by  examples. 


Ill  Examples  of  synthesis  of  the  control  functions 


Example  1.  Two  Null  Roots 
Given: 


1 

o 

1- 

o 

X  = 

X  + 

-0 

0- 

-1- 

u 


(5) 


and 


x  (0)  =  c  ,  x  (T)  =  0 


Find  u  such  that 


X3  =  dt 


(minimum) 


(6) 


where  u  is  constrained,  |u|^N. 
Solution: 

The  Hamiltonian  is 


H  =  P!x2  +  P2U  +  P3 


The  Maximum  of  H  minimizes  (6).  This  is  achieved  with 
u  =  Nsgn  p0 


(7) 


(8) 


The  adjoint  variable,  p_  ,  may  be  heuristically  related  to  a  negative  time 

Li 

solution  from  the  origin.  Letting  r=  -t  we  have 


x 


1 


(9) 


and 


x 


2 


=  -Nt 


(10) 


Eliminating  the  parameter  r  gives 

2 

_ 

X1  2N 


(ID 


This  is  the  equation  for  two  parabolas  with  u  =  ±N.  Of  interest  are 
those  parts  of  the  parabolas  which  are  associated  with  trajectories  coming 
into  the  origin  in  forward  time.  Accomplishing  this  in  (11)  and  using  the 
results  as  the  equation  of  the  control  function  gives 


u  = 


(12) 


This  is  indeed  the  optimum  minimum  time  feedback  control  function  and 
is  readily  simulated  with  analog  or  digital  means. 

The  system  with  optimum  control  is  shown  in  familiar  block  diagram  form 


in  Fig.  1.  Fig.  2  shows  a  typical  optimum  trajectory  in  the  state  space. 


FIG.  I  BLOCK  DIAGRAM  OF 
SYSTEM  WITH  MINIMUM 
TIME  FEEDBACK  CONTROL. 


FIG.  2  OPTIMUM  TRAJECTORY  FOR 
S2X(S)-  U(S) 

X|(0)«I.O,  X2(0)'0,  U*±  I 


Example  2:  A  Null  and  a  Real  Root 


Given: 


-o 

l- 

-o- 

X  = 

X  + 

-0 

-a  - 

-l- 

and 


x  (0)  =  c  ,  x  (T)  =  0 


(13) 


Find  u  such  that 


(minimum) 


where  u  is  constrained  |u|^N. 

Solution: 

Referring  to  (7)  and  (8)  which  will  be  of  the  same  form  here,  we  shall 
move  directly  to  the  synthesis  of  the  control  function.  It  is  useful  to 
uncouple  the  state  variables  to  simplify  the  geometry  of  our  trajectories 
and  to  be  able  to  treat  the  states  in  an  orthogonal  space.  This  is  ac¬ 
complished  by  taking  a  partial  fraction  expansion  on  the  transfer  function 
describing  each  state  with  respect  to  the  control  and  assigning  a  new  state 
vector  component,  y. ,  to  each  eigenvalue,  X.  For  example  let 


X  =  Gy. 


(14) 


where 


u(s) 

X1  s(s+a) 


'll 


u(s) 

s 


+ 


'12 


u(s) 

s+a 


(15) 


and 


su(s)  u(s)  u(s) 

X2  =  UsTa)  =g21  s  +  g22  s+a 


(16) 


giving 


rl/a 


G  = 


-l/cr 

1  - 


and 


G 


-1 


1 1 


1  J 


(17) 


(18) 


Let  us  solve  the  two  uncoupled  first  order  differential  equations  in 
negative  time  (t  =  -i)„  The  first  differential  equation  is 


y  =  -u 


(19) 


which  has  the  solution  (for  u  =  N) 


yl  =  yi  ^°)-Nr 


(20) 


Next  the  adjoint  variable  is  used  as  an  integrating  factor  to  make  the  differ¬ 
ential  equation  exact.  We  have 


y2  «  «y2-u 


(21) 


Multiplying  by  the  adjoint, 


p(t)  =  P  e 
o 


-o^- 


and  cancelling  Pq  gives 


-<*t 

u 


(22) 


Integrating 


-olt , 


e 


-aT  / 

e  u(  r)d  t 


(23) 


or 


<*T1 

y2  =  y2(0)e 


-  t) 


U  (T)d  T 


(24) 


Note  that  we  are  considering  u(i)  to  be  constant  over  the  interval.  Finally 


we  have  (for  u  =  N) 


(25) 


,n,  ,  N  (XT, 

y2  y2  0  e  +  a  H  ‘  e  > 


The  forward  time  solution  for  y  is 

La 


.  ,  _  y2^  N 

y2  S  s+a  s  (s+a) 


(26) 


or 


/ r\\  / -I 

y2(t)  =  y2(°)e  +  "  e  ) 


(27) 


In  negative  time  from  the  origin  we  have 


Y1  =  -N r 


(28) 


and 


N  „  (XT, 
y2  =  ~U  -  8  > 


(29) 


Again  eliminating  the  parameter  t  we  obtain  the  resulting  control 


u  =  -Nsgn  ^  -  — ^-(sgn  y2)ln(l  +  — “ — \/2  |)] 


(30) 


The  control  function  described  in  (30)  is  immediately  ready  for  digital 
simulation.  A  two  term  approximation  of  the  log  function  is  taken  for  analog 


synthesis . 


FIO.  3  OPTIMUM  TRAJECTORY  FOR 
S(S*  3.5  )  X  (S)«  U  (S) 

X,(0)>I.O,  Xf(0)=0,  U  =  ±  I 


u 


(31) 


"  'Ns9n  [yl  -  y2  +  ^y2ly2>] 


which  in  terms  of  the  x  variables  is 


u  =  -Nsgn  fx,  +  — x^  I  x„  |"1 
y  L  1  2N  2  1  2  1 J 

Figure  3  shows  a  typical  optimum  trajectory  in  the  state  space. 


(32) 


Example  3:  Two  Real  Roots 
Given? 


-  0  1  - 

-o- 

X  = 

X  + 

-yfi  -y-fi- 

-i- 

(33) 


and 


x  (0)  =  c.  ,  x  (T)  =  0. 

Find  u  such  that 


r 

x  =  /  dt  (minimum) 


Where  u  is  constrained,  |u|^N. 


Solution; 


As  before  we  will  uncouple  the  system 


u(s)  u(s)  u(s)  _ 

X1  (s+y)(s+0)  gll(s+y)  g12  (s+jS) 


(34) 


and 


_  su(s)  _  u(s)  u(s) 

X2  "  (s+y)(s+j3)  "  g21  (s+y)  g22  (s+jS) 


(35) 


giving 


x  =  Gy_ 


where 


G  = 


j3-  y  y-  l S 


JL-  —L 


y-  P  P-y 


(3  6) 


and 


G'1  = 


P  1 

y  1 


(37) 


The  solution  in  negative  time  from  the  origin  is 


and 


(38) 


y 


2 


(  1  -  e 


(39) 


By  eliminating  the  parameter  t  ,  from  (38)  and  (39)  an  expression  for 
the  control  function  is  obtained.  For  the  case  of  y<£,  this  expression  is 


u  =  -Nsgn  p^-(sgn  In  (1  +  ^-(yfj)  -  -jp(sgn  y2)  In  (1  + -jj-|y2  |)]  (40) 

The  control  above  is  readily  achieved  by  digital  means.  A  quadratic  ap¬ 
proximation  to  the  log  function  is  readily  generated  to  give  control  by  analog 
means.  This  is  (for  y</3) 


1  y  i  i 

.  &  1  .  1  "1 

Lyl  "  2N  Y1  'yl  ' 

’  y2+  2N  y2  'y2  U 

which  in  terms  of  the  x  variables  is 


(41) 


u  =  -Nsgn  [(/3-y^  -  ^-(jfc^  +  x2)  |0Xj  +  x2  |+  ^“(y^  +j^)  \y^  + ^  |]  (4F) 


It  should  be  noted  here  that  whenever  the  exact  control  function  is  approx¬ 
imated,  the  possibility  of  chatter  motions  exist.  This  is  true  for  controls 
described  in  (31),  (32),  (41),  and  (49).  The  coefficient  on  the  quadratic 
term  may  be  adjusted  to  eliminate  this  [  5  ]  . 

In  systems  where  the  ratio  of  the  real  roots  is  an  integer  or  nearly  so, 
a  simple  optimum  control  may  be  generated.  The  equivalent  of  (38)  and  (39) 
expressed  as  function  of  time  are 

r  =  -^-ln  (1  +  ^-lyJ)  (42) 

or 


v  N/y 

T=  In  (l  +  -*-|yi|)  (43) 

and  similarly 

R  N/£ 

T=  ln  (  1  +  ~jfW2  I)  (44) 

Now  let  us  use  the  arguments  of  the  logarithms  in  (43)  and  (44)  to  obtain 
the  control  function.  This  is  (for  y  </3) 

r  v  0/r  «  -i 

u  =  -Nsgn  [(sgn  y^  (1  +  |)  -  (sgn  y^)  (1  +  — jj-|y2  |)  J  (45) 


where  f3/y  is  an  integer  or  nearly  so.  Now  simply  use  the  binomial  expansion 
in  (45)  to  obtain 


u  =  -Nsgn  {(sgn  y^  [|y}  |+  IYj  f  +  •  •  .]-y2} 


(46) 


For  example,  let  y=  1/2,  jS  =  1 .  The  optimum  control  which  yields  identical 
switching  to  the  function  given  in  (40)  is 


Figure  4  shows  an  optimum  trajectory  using  either  (40)  or  (46'). 


(46') 


Example  4:  Two  Imaginary  Roots 
Given? 


— 

—  — 

0 

1 

X  + 

0 

2 

-60 

0 

l 

_ 

_ 

_  _ 

and 


x  (0) 


=  ,c  , 


x  (T)  =  0 


(47) 


Find  u  such  that 


x2 


FIG.  4  OPTIMUM  TRAJECTORY  FOR 

(S+  I  )  (S^O.5)  X(S)«  U(S) 
X,(0)-I.O,  (O)-O,  U-±l 


■T 


x 


3 


dt 


(minimum) 


where  u  is  constrained,  |u|^N. 

Solution: 

It  is  noted  that  the  zero  trajectories  are  half  circles  with  centers  at 

(  ±  -  ,0).  It  can  be  shown  [1,4]  ,  that  the  optimum  switching  is  a  set  of 

a,' 

half  circles  arrayed  along  the  x axis.  The  optimum  control  function  may 
then  be  described  with  the  aid  of  a  fourier  series  as 


u 


r  2 

-Nsgn  [~^T+  (sgn  x^ 


(48) 


A  simple  and  effective  approximation  for  analog  simulation  is  giv  en  by 


x  1  2 

u  =  -Nsgn  [~ — +  1.016  (sgn  x^  V  |sin  x1  |J 


(49) 


The  system  is  described  in  Figure  5  ,  with  typical  trajectory  using  the  above 
control  function. 


Example  5:  Control  of  a  second  order  nonlinear  system  (Van  der  Pol). 
Given: 


”  0  1  ” 

1 

o 

_ 1 

# 

X  = 

X  + 

_-l  (1  -  xx2)_ 

_  1 

u 


(50) 


X2 


FIG.  5  OPTIMUM  TRAJECTORY  FOR 

(S2+l  )  X(S)-  U(S) 
X,(0)-I.O,  X2(0)-0,  U-±l 


Find  u  such  that 


x3  ■  1  dt 


(minimum) 


where  u  is  constrained,  |u  |^N.^ 

Solution: 

The  problem  is  analyzed  by  taking  the  solution  to  the  linear  problem 

[3], 


-  0 

i  - 

o  “ 

• 

X  = 

X  + 

_-i 

-2 

i 

u 


(51) 


and  simply  let 


c  = 


1 

2 


o  * 

(  1  -  xj) 


(52) 


For  systems  with  complex  roots  the  states  are  not  completely  uncoupled. 
However,  a  transformation  is  applied  which  places  the  real  part  of  the 
roots  on  the  main  diagonal.  Thus  (51)  is  transformed  with 


x  = 


“  i 

_  0 

l/v  _ 

(53) 


*Here  x^  denotes  a  weighted  mean  of  its  present  and  desired  final  states. 


and 


where 


giving 


--C 

v~ 

“C  " 

z  + 

--V 

-c. 

_  _ 

(54) 


(55) 


The  negative  time  solution  from  the  origin  is 


y,  =  -l  + 


Cr 

e  cos  vt 


(56) 


y 


2 


sin  v r 


(57) 


for 


u  =  +  1  and  0<vt<  it  . 


After  eliminating  the  parameter  t  from  (56)  and  (57),  an  expression 
for  the  control  function  is  obtained  in  the  neighborhood  of  the  origin 
(  |<1  +  a2,  where  a  =  e^^V)  , 


u  =  -sgn  {(x12  +  2Cx1x2  +  x2)sgn  x2  +  2(xx  +  ^)  +  (eZ-l)sgn  x^ 


(58) 


where 


z  =  2f  arc  cos 


1  -  (x  +  Cx^sgn  xi] 


FT- 


(59) 


2  2 
2(x1  +  fx2)sgn  X1  +  X1  +  2CX!X2  +  x2 


For  |x^  |  a  1  +  a  ,  we  may  use  a  linear  approximation  to  the  optimum  switch- 
ing  curve.  This  is  simply 

u  =  -sgn  [n2  +  -l°  £  (Xj  +  Cx2)  +  (“  sgn  xj  (60) 

The  control  functions  above  were  checked  for  various  initial  conditions 

with  digital  computer  simulation. 

A  quadratic  approximation  for  the  small  signal  control  of  (58)  is 

u  =  -sgn  [2(x1  +  Cx2)  -  x^  |Xj  |  -  2^^  +  x2  I  x2  I  ]  (61) 

A  control  of  the  form  of  (58)  and  (60)  is  demonstrated  in  Figure  6,  Also 

a  typical  uncontrolled  limit  cycle  is  shown. 


FIG.  6  CONTROLLED  AND 
UNCONTROLLED  TRAJECTORIES 
FOR  VAN  DER  POL  EQUATION 


WITH  U  «  i  I 


IV  CONCLUSIONS 


It  is  hoped  that  this  rather  compact  compilation  of  optimum  and 
quasi-optimum  minimum  time  control  functions  may  be  useful  to  the  practicing 
engineer.  The  results  of  control  of  a  nonlinear  system  using  linearization 
about  each  state  point  in  a  trajectory  were  reassuring  to  the  doubtful.  The 
solutions  were  all  checked  against  true  optimum  trajectories  by  coming  from 
the  origin  in  negative  time  with  the  control  satisfying  the  Hamiltonian  (2). 
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